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Solving underdetermined systems with error-correcting codes* 

Ted Hurley'^ 


Abstract 

In an underdetermined system of equations Ax = y, where A is an m x n matrix, only u of 
the entries of y with u < m are known. Thus EjW, called ‘measurements’, are known for certain 
j £ J C {0,1,. .., m — 1} where {Ei, i = 0,1,..., m — 1} are the rows of A and | J| = u. It is required, 
if possible, to solve the system uniquely when x has at most t non-zero entries with u > 2t. 

Here such systems are considered from an error-correcting coding point of view. The unknown x 
can be shown to be the error vector of a code subject to certain conditions on the rows of the matrix 
A. This reduces the problem to finding a suitable decoding algorithm which then finds x. 

Decoding workable algorithms are shown to exist, from which the unknown x may be determined, 
in cases where the known 2t values are evenly spaced (that is, when the elements of J are in arithmetic 
progression) for classes of matrices satisfying certain row properties. These cases include Fourier 
n X n matrices where the arithmetic difference k satisfies gcd(n, k) = 1, and classes of Vandermonde 
matrices V [xi,X 2 , ■ ■ ■, Xn) (with Xi 7 ^ 0) with arithmetic difference k where the ratios Xijxj for i ^ j 
are not roots of unity. The decoding algorithm has complexity 0{nt) and in some cases, including 
the Fourier matrix cases, the complexity is 0{t^). 

Matrices which have the property that the determinant of any square submatrix is non-zero are 
of particular interest. Randomly choosing rows of such matrices can then give t error-correcting pairs 
to generate a ‘measuring’ code = {Ej\j € J} with a decoding algorithm which finds x. 

This has applications to signal processing and compressed sensing. 


1 Introduction 

Underdetermined systems Aw = y are considered where A is an m x n matrix, w an n x 1 unknown 
vector and u entries of y are known with u < m. It is given that w has at most t non-zero entries and 
that u > 2t. Thus the vector w = (oi, a 2 , ■ ■ ■, OLn)"^ is known to have at most t non-zero entries but the 
positions and the values of these non-zero entries are unknown. 

Let the rows of A be denoted by {Eo,Ei, ... ,En-i}. Hence EjW are taken or known for j £ J = 
{ji) 1 / 2 ) • • ■) ju} where u > 2t, and the problem is to determine w, if possible, from the ‘measurements’ 
{EjW,j £ J}. These measurements are sometimes referred to as ‘samples of w\ 

This has applications to signal processing and compressed sensing for which there is a huge and 
extensive literature. A signal may be measured or sampled by rows of a matrix. The work by Candes, 
Romberg and Tao, [3], is a basic reference for recent treatments of compressed sensing. 

Here a linear algebra approach is taken based on error-correcting codes. It is shown that when the 
{Ej \j £ J} generate a code such that the distance d{C) of the dual code C satisfies d[C) >2t + l, 
where t is the maximum number of non-zero elements of rc, then w can be obtained by decoding. The 
problem then is to find a suitable decoding algorithm which is efficient and stable. 

A general algorithm, which is a decoding process in disguise, for cases where there exist error- 
correcting pairs for C (see section 12.41 below for definition) is developed in Section SI In certain cases 
when the measurements are evenly spaced, and with additional properties on the rows of A, error- 
correcting pairs are explicitly shown to exist. In these cases an explicit decoding algorithms are given in 
Algorithm 14.II and in Algorithm 14. 2 1 Evenly spaced here means that the elements in J are in arithmetic 
sequence. 
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When the arithmetic difference k (in J) satisfies gcd(n, k) = 1 the Fourier n x n matrix is shown 
to satisfy the conditions and error-correcting pairs are exhibited which then solves systems when A is 
a Fourier matrix. An algorithm for the Fourier nxn matrix, with the proviso that gcd(n, fc) = 1, 
is then given in Section 18.11 Algorithm 18.21 When fc = 1 (that is, when the measurements are taken 
consecutively) the algorithm for the Fourier matrix case is similar to that obtained in [12]. This paper 
m also makes the point “to make the algorithm more robust to noise we have to increase the number 
of available samples .. and apply some denoising algorithm to the samples”. 

The Vandermonde matrix A = V{xi,X 2 , ■ ■ ■ ,Xn), (xi ^ 0), in which the quotients Xijxj, for i ^ j, 
are not fc*^ roots of unity, where fc is the arithmetic difference in J, is shown to satisfy the general 
requirements and error-correcting pairs are explicitly given for these cases. An algorithm for finding a 
solution of Aw = y for such a Vandermonde matrix A with rows Ei where {Ejw\j G J} are known with 
J in arithmetic sequence with difference fc such that Xi/xj, {i ^ j, 1 < i,j < n) is not a fc*^ root of 
unity), is given in Section 0 Algorithm l7.ll 

The algorithms in general involve a maximum of 0{nt) operations but in some cases a maximum 
of 0{t^) operations only is required. The Fourier nxn matrix case requires max(0(t^),0(nlogn)) 
operations and the operations are known to be particularly efficient and stable. 

The technique involves considering the problem as a coding/decoding problem and then to find 
suitable decoding algorithms. A particularly useful decoding algorithm involves finding error-correcting 
pairs for the code. The method of error-correcting pairs is due jointly to Pelikaan |13] and Duursma & 
Kotter [4|. 

A technique is derived in Section]^ to deal with a type of random selection of rows of a matrix which 
has the property that the determinant of any square submatrix is non-zero. Matrices which satisfy the 
condition that the determinant of any square submatrix is non-zero include the Fourier nxn matrices 
where n is prime (Chebotarev’s Theorem), real Vandermonde matrices with positive (distinct) entries 
and Cauchy matrices. 


2 Coding theory method 

Consider w as the error vector of a code. As w has at most t non-zero entries, a Terror correcting code 
for which w is the error vector is then required. A method which can locate and identify the ‘errors’, 
which are then the entries of w, solves for w. 

A basic reference for coding theory is [5]. A code C over a field F is a subset of F" and all codes 
considered are linear. An (n, r) code is a code of length n and dimension r and an (n, r, d) code is a code 
of length n, dimension r and (minimum) distance d. An in, r, > d) code is a code of length n, dimension 
r and distance > d. An mds (maximal distance separable) code is an (n, r) code of distance (n — r -1- 1), 
that is, an mds code is an (n, r, n — r -|- 1) code. 

2.1 Rows generating codes 

Let the rows of an m x n matrix A be denoted by {Fo,Fi,... ,Em-i} and assume these are linearly 
independent. Measurements are taken of Aw, that is certain EjW are taken or known for j G J = 
{ji) J 2 ; • ■ • jju} C {0,1,..., m — 1} and it is given that u >2t where t is the maximum number of non¬ 
zero entries of w. It is clear it may be assumed without loss of generality that m = n as just a subset of 
the rows of A are used. 

Let = {Ej ^, Ej ^,..., Ej^). Think of as a code and its dual (orthogonal complement) is denoted 
by C. Now C'*' is an (n, u) code and so C is an (n, n — u) code which has an (n — u) x n generator matrix 
denoted by C. Thus v G C ii and only if EiV = 0 for each Ei G or equivalently v G C \i and only if 
Cv = Ouxi where C is the uxn matrix with rows consisting of the elements {Fjj,Fj 2 ,... ,Ej^}. 

Then = 0(n-u)xuj which is equivalent to 00"^ = Ouxin-u)t is the set-up for the generator 

matrix/check matrix of a code and its dual. 

If C is a t-error correcting code then it may be used to obtain w, provided of course a practical 
decoding algorithm is available. 

Now C is an (n, n — u) code and is t-error correcting if its distance is > 2t -|-1. The maximum distance 
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that C can attain is u + 1. For u = 2t this requires C to be an (n, n — 2t, 2t + 1) code, that is, it must 
be an mds code. Now C is an mds (n, n — 2t, 2t + 1) code if and only if its dual C-^, with matrix C, is 
an (mds) (n, 2t, n — 2t + 1) code. The check matrix, C, of C is an {2t x n) matrix. Thus C has distance 
2t + 1 if and only if any 2t columns of C are linearly independent - see for example Corollary 3.2.3 in 
[2] for details on this. Thus for u = 2t \i is required that any 2t columns of C, which is a 2t x n matrix, 
are linearly independent. 

For u > 2t \i is required that C be a (n, u, > {2t + 1)) code. Now C, a.n u x n matrix, is the check 
matrix of C and thus it is required that any 2t columns of C be linearly independent. If any u columns 
of C are linearly independent then of course any 2t columns are linearly independent and C is at least 
Terror correcting. 

There are a number of cases where it can be assured that C is Terror correcting. 

When A satisfies the property that the determinant of any square submatrix of A is non-zero then 
any choice of r rows of A gives an mds (n, r, n — r -|- 1) code, [S]. The Fourier n x n matrix for a prime 
n has this property by a result of Chebotarev 0. Thus as shown in [8] any code obtained by taking 
(n — 2t) rows of this Fourier matrix gives an (n, n — 2t, 2t + 1) mds code. Hence when A is the Fourier 
n X n matrix for n a prime any such C has the required mds property. A Vandermonde real matrix with 
positive entries has this property. Corollary 16.51 below. 

In general ii V(xi, X 2 , ■ ■ ■, Xn) is a Vandermonde matrix and the in C-^ are evenly distributed 
with arithmetic difference k such that the ratios Xi/xj for all i ^ j are not roots of unity then C-^ 
is an mds codes, see Corollary 16.31 and Section [7] below. For a general n x n Fourier matrix it will be 
shown in Section |8] that mds codes are obtained when the Ej in C'^ are evenly spaced with arithmetic 
difference k satisfying gcd(n, k) = 1. 

When A is a Cauchy matrix, it also has the property that the determinant of any submatrix is 
non-zero but this case can be highly unstable and a decoding method is not easy to obtain. 

2.2 Unit-derived codes 

Suppose AB = 1 for nxn matrices A, B. Then as shown in taking any r rows of A gives a generator 
matrix of an (u, r) code and the check matrix may be obtained by deleting the corresponding r columns 
of B. Alternatively any r rows of A gives the check matrix of an (u, n — r) code whose generator matrix 
is obtained by deleting the corresponding r columns of B. 

This is the situation we have for the underdetermined given system Aw = y when A is an n x n 
matrix with inverse B. 

2.3 Decode to solve 

Suppose now that C has the required property that any 2t columns are linearly independent. Then C 
has distance > 2t -|- I and so the code can correct the ‘errors’; it can find the elements of w using the 
check matrix C. The problem is to find a suitable decoding method, that is, a method to locate and 
quantify these errors. The method should be of reasonable complexity and stable for applications. 

We show now that when the measurements are evenly spaced within certain matrices an error- 
correcting (decoding) method exists which identifies w. In general the identification can be done in at 
worst 0{tn) operations but in some cases it may be done in at worst 0{t^) operations. In practical 
applications t is often much smaller than n. 

2.4 Error-correcting pairs 

The method of error-correcting pairs, when they can be shown to exist, may be used to locate and 
determine the ‘errors’, and these ‘errors’ then determine the elements of w. The method of error- 
locating and error-correcting pairs is due jointly to Pellikaan [T3] and to Duursma and Hotter [3]. The 

A proof of this Chebotarev theorem may be found in [5] and proofs also appear in the expository paper of P.Stevenhagen 
and H.W Lenstra M ; paper contains a relatively short proof. There are several other proofs in the literature some 
of which are referred to in m Paper m contains a proof of Chebotarev’s theorem and refers to it as ‘an uncertainty 
principle’. 
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method used here is based mainly on that of Pellikaan [T3] . 

Let F he a, field and C a (linear) code over F. Write n{C) for the code length of C, its minimum 
distance is denoted by d{C) and denote its dimension by k{C). 

Now Wi denotes the component of re G F'^. For any w S F" define the support of w by supp(w) = 
{i\wi ^ 0} and the zero set of w by z{w) = {i\wi = 0} . The weight of w is the number of non-zero 
coordinates of a and denote it by wt{a). The number of elements of a set / is denoted by |/|. Thus 
wt(a) = I supp(i(;)|. 

We say that w has t errors supported at / if w = c-|-e with c G C and / = supp(e) and \I\ = t = d{w, C). 
For C a linear code, the vector space of F linear functionals on C is denoted by 

The bilinear form <, > is defined by < a, 6 >= Gibi. For a subset C of F”, the dual C-^ of C in 
F” with respect to the bilinear form <, > is defined by C-^ = {a;| < x,c >= 0, Vc G C}. 

The sum of two elements of F" is defined by adding corresponding coordinates. Of use in these 
considerations is what is termed the star multiplication a * b oi two elements a,b € F" defined by 
multiplying corresponding coordinates, that is (a * b)i = Oibi. For subsets A and B of F" denote the set 
{a * b\a & A,b & hj A * B. If A is generated by X and B is generated by Y then A* B is generated 
by X * F. 

Definition 2.1 Let C be a linear code in F". Define the syndrome map of the code C by s : F" —^ 
{C^Y,w 1 -^ {v i-P-< v,w >). 

For a received word w G F" we call s{w) the syndrome of w with respect to the code C. 

Definition 2.2 Let A,B and C be linear codes in F". Define the error locator map of a received 
word w with respect to the code C by : A B'^, a i—>• (& i—>■< w,a*b >). 

Remark: li A* B C C-^ and re is a word with error e, then F^, = Eg. 

Definition 2.3 Suppose I = {ii,i 2 , ■ ■ ■ At} , where 1 < ii < ... < it < n . Let A be a linear code in F” 

. Define A{I) = {a G A\ai = 0,Vj G /}. 

Definition 2.4 Define the projection map ttj : F" —>• F* by ttj{w) = {wi ^,..., Wi^). Define Aj = ttj{A). 
Let e G F". Denote iTj^e * A) by eAj. 

Definition 2.5 Suppose L = {F, * 2 , • ■ ■, *s}- Define the inclusion map ii : F* ^ F" by mapping the 
component, Wj of w into the coordinate for all j = 1,2,... ,t and zeros everywhere else. 

Define the restricted syndrome map sj : F*^ —t by sj = s * ij. 

Definition 2.6 Let A,B and C be linear codes in F”. We call {A,B) a Terror correcting pair for C if 

1) A*BCC^ 

2) k{A) > t 

3) diA) + d{C) > n, 

4) d{B-^) > t. 

Definition 2.7 For an element w G F" define F^, : A —>• B'^, a i—>■ lb i—>■< w,a*b>). 

Now refer to the paper |13) and in particular Proposition 2.11 therein. The paper contains the following 
algorithm, Algorithm 2.3, for locating and determining the values of errors in the code C when error- 
correcting pairs exist for C: 

Algorithm 2.1 (see \13f . Algorithm 2.3:): 

1.1 Compute ker(Fu,). 

1.2 //ker(Fu,) = 0, then goto 3.2. 

1.3 //ker(Fu,) A 0) then choose a nonzero element a G ker(Fu,). 
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Let J = z{a). 

2.1 Compute the space of solutions of sj{x) = s{w). 

2.2 If sj{x) = s(w) has no or more than one solution then goto 3.2. 

2.3 If sj{x) = s(w) has the unique solution xq , then compute wt{xo). 

2.4 Ifwt{xQ) > t , then goto 3.2. 

3.1 Print: “The received word is decoded hy”; Print: w — ij{xo); goto 4- 

3.2 Print: “The received word has more than t errors.” 

4 End. 

In our case the actual errors are the values required and so 3.1 is changed accordingly. Case 3.2 will not 
arise as by assumption w has at most t non-zero entries or else it will show up pointing out an error in 
this assumption. 


3 Solve the system of equations by decoding 


Recall the star product u * v of two vectors u,v d F^. This is defined by multiplying corresponding 
coordinates, that is {u * v)i = UiVi. For subsets U and V of denote the set {u * v\u G U,v £ V} hy 
U*V. 

Consider now a matrix A with rows {Eq, Ei,... ,En-i}. Assume the matrix A satisfies conditions 


(a) Ei * Ej = Ei^j for i + j < {n — 1). 

(b) Let J C {0,1,..., n — 1} be in arithmetic sequence with |J| = r. Then the code generated by 
{Ej,j £ J} is an mds (n,r,n — r -|-1) code. 


(a) and as follows: 


In the above condition (a) it is required that i + j < (n — 1). where A has rows {Eg, Ei ,..., En-i}. 
When for example A is the Fourier nxn matrix then Ei+j is always defined with Ei+j = Ei+j mod n- In 
other cases also Ei may be defined for alH G Z where Ei,h < i < {n — \) correspond to the rows of A as 
for example when A is a Vandermonde matrix. In such cases the conditions | (a) | and | (b) | may be replaced 
as follows. Let A have rows {Eg, Ei,..., En-i} such that Ei are defined for i > 0 (which coincide with 
rows of A for 0 < i < n — 1). Assume A satisfies conditions m and m as follows. 


(A) Ei * Ej = Ei+j. 

(B) Any J C {0,1,..., n — 1} in arithmetic sequence is such that the code generated by {Ej,j £ J} is 
an mds {n,r,n — r + 1) code where | J| = r. 

Only a subset of the rows of A are used in the general theory. We may assume A has first row Eg 
by the following consideration. Suppose A has rows numbered {Ei,E2, ... En-i} satisfying conditions 


1 X n vector consisting of all I's; this new matrix will still be referred to as A and satisfies the required 
conditions with 0 < i,j. 

Assume then from now on in this section that the matrix A satisfies conditions |(a)| and |(b)| or where 
appropriate conditions |(A)| and |(B)| Matrices which satisfy conditions |(a)| and |(6)| or conditions |(A)| and 
m are given in subsequent sections. 

Rows of A are given to form C"*- = {Ej \j £ J}, as in Section lOI where now the Ej are evenly 
distributed, that is, C-*“ = {Ei, Ei+j, Ei+2j, ■ ■ ■ Eij_(^2t-i)j)- (It is assumed that 2 t < n and that are 
defined for 0 < fc < j -I- (2t — l)j.) 

With this set-up it is possible to get a t-error correcting pair, (see definition l2.6L for C the dual code 
of C-*“. In these cases the vector w (from Aw where rows EjW,j £ J are known) which has at most t 


(a) and or conditions m and m with I < i,j. Introduce a first row Eg into A where Eg is the 
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non-zero entries, may be obtained by applying the method of Algorithm 12.II above due to Pellikaan [T5] 
to give an appropriate implementable algorithm in which to find w. It will be shown that the solution 
may be obtained in at most 0(tn) operations and in some cases in at most 0{t^) operations. 

Take initially the case C-*- = {Ei, E 2 , ■ ■ ■, E 2 t), that is, the Ei are consecutive starting at Ei] the 
more general case will be dealt with similarly. 

Theorem 3.1 Let C'^ = {Ei, E 2 , ■ ■ ■, E 2 t) with 2t < n and C is the dual of the code generated by C'^. 
Define U = {Ei, E 2 , ..., Et+i), V = {Eq, Ei, ..., Et-i). Suppose that C-^, U, V generate nids codes. Then 
(U,V) is a t-error correcting pair for C. 


Proof: Now Ei * Ej = Eij,.j. Then A* B f- {Ei, i? 2 ,..., E 2 t) C C"*". 

Note that a code is an mds code if and only if its dual is an mds code. 

Now C is an (n, n — 2t, 2t+l) code, U is an (n, t+1, n—t) code, V is an (n, t, n—t+1) code and is an 
(n, n—t, t+1) code. Thus k{U) = t+1 > t, d{U)+d{C) = (n—t)-|-(2t-|-l) = n-|-t-|-l > n, d{V-^) = t-|-l > t 
and so {U,V) is a t-error correcting pair for C (see Definition 12.61) . □ 

In the general case we have the following. The proof is similar to the proof of Theorem 13.11 above. 
Let Eq be the vector with all 1® as entries. The suffices Ij in the following theorems actually mean I *j, 
the multiplication of I by j. 

Theorem 3.2 Let C-^ = (Ai, Ai+j, £'^+ 2 ^,..., £'i+( 2 t-i)j)- The dual code of is C. Define U = 
{Ei, Ei.i.j, Ei^i-j,, Ei.^.tj),V = {Eq, Eij, E2j, ■ ■ ■, ) . 

Suppose C-^, U, V generate mds codes. Then {U, V) is a t-error correcting pair for C. 

In a set-up there may be more than one error-correcting pairs and it may be useful to consider others. 
For example we could interchange some of the elements of U,V. 

Theorem 3.3 Let C-*- = {Ei,Ei+j,Ei+ 2 j, ■ ■ ■, £i+( 2 t-i)j)- The dual code of is C. Suppose a vector 
Tdi—j exists with Ei—j Ej — Ei. Define U — {Ei—j, Ei, Eij-j,..., £ 2 -t-(i—i)j )5 ^ — {T^^j 5 Td 2 j, • • •, Ttj ). 
Suppose C-*-, U, V generate mds codes. Then {U, V) is a t-error correcting pair for C. 

It is thus noted that there may exist a number of different error-correcting pairs for the same code. 

Example 3.1 Let A have rows Ei with Ei * Ej = Eij.j. Denote Ei by i and thus Ei * Ej = Ei^j 
translates to i*j = i-\- j. Let = (5, 7,9,11,13,15) so that C is 3-error correcting (when is mds). 
The following are 3-error-correcting pairs. 

• t/=(5,7,9,ll),F=(0,2,4). 

• t/= (3,5,7,9), T= (2,4,6). 

• t/=(l,3,5,7),T=(4,6,8). 

• When —i exist (as for the Fourier matrix) it’s clear that further error-correcting pairs for C can 
easily be found. 

3.1 Interpretation 

Consider C-^,U,V as in Theorem 13.21 Now apply Algorithm 12.11 (derived from [T3]) using the error- 
correcting pairs found in Theorem 13.21 (Other correcting pairs, as shown can exist, may also be used.) 
We show that the error locations may be obtained from the matrix given in the following Theorem 
relative to the bases {Ei, Ei+j,..., Ei+tj{ for U and {wq, wi, ■ • ■, Wt-i} for V'^, where tOi : Ekj 1 —J- 5ik for 
i = 0, 2,..., t — 1. Write = £i+(fc_i)j for fc = 1, 2,..., 2t. Thus U has basis {£ 1 , £ 2 , • ■ •, £t+i} and 
C-*- has basis {£ 1 , £ 2 ,..., £ 2 *}. Let as =< w, Fg >= FgW = Ei^(^s-i)jW ioi s = I,... ,2t and these are 
known. 

Recall, definition 12.71 that E^, : U ^ V'^,u 1 -^ {v >->■< w,u*v >). 
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Theorem 3.4 has the following matrix relative to the basis {Ti, F2,. ■., Tt+i} for U and the basis 


W2, . 

.., wt} for 

V'^, wh 

/«! 

Ot 2 

at-i-i\ 

a 2 

as 

at-i-2 

as 

04 

at-i -3 

\at 

at+1 

a2t / 


Proof: 

Now Eyj : U ,u 1—>■ {v i-X w,u*v >). 
Thus Eyj works as following on Fi. 


Fi 


/ Fq !-)■< w,Fi* Eo > \ 


( Eq h>< w,Fi > \ 


/ Eo^ ai \ 

Ej 1 — >■< w, Fi * Ej > 


Ej !-)•< w, F 2 > 


Ej 02 

w,Fi * E(j^_i)j >j 


w,Ft >j 


'-t atj 


Thus Eyj : Fi 1-^ aiuji + 02^2 + ... + Otw*. Similarly Eyj : F^ 1-^ a^oji + ai+iOJ2 + ... + ai+t-iOJt- 

/ ai 02 at+A 


Hence E^ : (Fi, T' 2 , ■ • ■, A+i) H> {wi,W 2 , ■ ■ ■ ,wt) 


0 L 2 03 


Ott+2 


\at at+i ... 02t / 

Thus the matrix of E^ relative to bases {A, F2,..., A+i} for U and the basis {wi, a;2,..., Wt} for 
/oi 02 ... at+i\ 

02 03 ... at+2 


is 


\Ot Ot+I ... 02 t / 


□ 

The matrix in Theorem [SH is a Hankel matrix and its kernel in general can be obtained in at most 
0{t^) operations. Just any non-zero element of the kernel is required. 

It is then required to multiply a non-zero element of the kernel of the matrix by (A, A,..., A-i-i) to 
get an actual kernel element of the mapping E^,. 

Suppose then such an element a G kerF^ has been found. Let J = z(a) = {j\aj = 0} which is the 
set of locations of the zero coordinates of a. It is now required to compute the space of solutions of 
sj{x) = s(w). Suppose J = {ii, 12 ,..., **} and let x G F". Then sj{x) = s * ij(x). Let ij{x) = y and 
suppose now y = ij{x) is xi in ii position, X 2 in Z 2 position and in general Xk in ik position and zeros 
elsewhere. 

Now s : F” ^ is u !->■ (n >->■< v, u >). A basis for C-*- is {Fi, F 2 ,..., F 2 t}. 

/ Fi !->■< Fi, w > = Qfi \ 

F 2 !->■< E2,w > = a2 

Hence s : w 1 -^ 

\At'-t< F2t, w > =a2tj 

Since A G F", let A = (A,i, A, 2 , •. ■, A,n) for i = 1, 2 ,..., 2t. 

Now 

sj{x) = s * ij{x) and so: 


sj : X M- 


1 Fi !-)■< Fi,y > 

— Aj'i + X2Fij^ + . 

. + XtFij^ \ 

F 2 !-)■< F2,y > 

= X 1 F 2 J -1 + X 2 F 2 J 2 + ■ 

■ + XtF2J^ 

\At '-t< F2t,y > 

= XiF2tjx + 2:2 At ,42 + ■ 

■ + XtF2t,jJ 
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Hence solving sj{x) = s(w) reduces to solving the following: 


fFi,n 

Fl,j2 

•• Fi,h\ 




\ 

F2,ji 

F2,j2 ■ 

•• F2,n 


X2 


02 

KF2t,ji 

F2t,j2 • 

F2t,xJ 




\a2tj 


The value of w is then the solution of these equations with entries in appropriate places as determined 
by J. The values of are known and in some cases have nice forms. The matrix in (HD can be of 
a special type (for example, submatrix of Vandermonde and/or consisting of roots of unity) enabling 
practical (easier) calculation of a solution to equations (HD. 


4 Algorithms 

Now algorithms are given based on the results of Section [3] with which to solve the underdetermined 
systems in various cases. Suppose y = Ax where H is an n x n, w an n x 1 unknown vector and where 
u entries of y are known. It is given that w has at most t non-zero entries. Denote the rows of A by 
{Eq, Ex, ..., En-i} and suppose that Ei * Ej = Ei^j. 

Measurements EjW (values of y) are taken or known for j ^ M = {ji, j 2 , • ■ • ,ju} C {0,1,..., (n — 
1)} where u > 2t. Suppose the measurements satisfy the conditions of Theorem 111.21 with = 
{Ei, Ei+j,Ei+ 2 j, ■ ■ ■, Ei^^ 2 t-i)j) and C is the dual code of the code generated by (7-*-. We give an Algo¬ 
rithm to calculate the value of w under these conditions when the measurements are in an arithmetic 
progression (evenly distributed) and subject to conditions of Section [31 


4.1 Case k = 1 


We first for clarity give the algorithm when M = {1, 2,... ,u} and u = 2t. This is easier to explain and 
avoids the complicated notation necessary for the general case given below. 

The set-up then is that A is an n x n matrix with rows {Eq, Ei,..., En-i} and that measurements 
EiW are taken for i = 1,2,... ,2t. It is assumed that w has at most t non-zero entries. Then w is 
determined as follows: Let ai =< w, Ei >= EiW for i G J = {1, 2,..., 2t}. 

Algorithm 4.1 


• Find a non-zero element x'^ of the kernel of E 

\at at+i ... a2t ) 


^ a\ 02 ■ • ■ at+i\ 

02 Cka ■ • • O't+2 


• Let a = {Ei,E 2 , ..., Et+i)x'^. (Any non-zero multiple of a will suffice as we are only interested in 
the zero entries of a. Note that a is a 1 x n vector.) 


• Let z(a) = {j\aj = 0} which is the set of locations of the zero coordinates of a. 
{ji) 12 ) ■ ■ ■ jjt} and denote this set by J. 


Suppose z{a) = 


• Solve sj{x) = s{w). This reduces to solving the following. Here Ei = (i?i,i, Ei^ 2 , ■ ■ ■, Ei^n)- 


^ Fiji 

F1J2 

Ex,,A 




(ax\ 

F2J1 

F2J2 ■ 

■ F 2 Jt 


X 2 


02 

KF2t,ji 

F 2 t,j 2 ■ 

■■ F 2 t,jtJ 


\XtJ 


\a2tj 


• The value of w is then the solution of these equations with entries in appropriate places as deter¬ 
mined by J. 


The complexity of the operations is discussed in Section 14.21 
















4.2 General case 

Suppose 4 is an n X n matrix with rows {-Bqj Ei,..., En-i} satisfying Ei * Ej = 

Measurements EjW are taken or known for j £ J = {ji, j 2 , ■ ■ ■ ^ju} where u > 2t. The elements in J 
are in arithmetic progression with difference k so that the satisfying gcd(n, k) = 1. Then w is calculated 
by the following algorithm. 

Let Qffc =< w, Ej^ >= Fj^w for jk € J. Define Ei = Ej. for ji S J and Fq = Ej^-k with indices taken 
mod n. Let F* = ■ ■ ■, 

Algorithm 4.2 



/ Cti 

02 

■ Ot+A 

• Find a non-zero element x'^ of the kernel of E = 

CH2 

O3 

■ Ot+2 


\at 

Ot+1 

024 / 


• Let a = {Fq, Fi,..., Ft)x'^. (Any non-zero multiple of a will suffice as we are only interested in the 
zero entries of a. Note that a is a 1 x n vector.) 

• Let z(a) = {j\aj = 0} which is the set of locations of the zero coordinates of a. Suppose z{a) = 
{jr,* 2 , • ■ • ,jt} and denote this set by J. 


• Solve sj{x) = s{w). This reduces to solving the following: 



F 1 J 2 

■■ FLn\ 


AA 


/oA 

F2,ji 

^2,32 ■ 

■ F,,,, 


X2 


02 

KF2t,ji 

F2t,32 • 

■■ F2t,jt/ 


\Xt/ 


\a 2 tj 


• The value of w is then the solution of these equations with entries in appropriate places as deter¬ 
mined by J. 


5 Random selection 

This section initiates a method for working with randomly chosen error-correcting pairs. It is independent 
of subsequent sections. 

Suppose the n x n matrix A in the underdetermined system Aw = y has the property that the 
determinant of any square submatrix is non-zero. Then the choice of any r rows of A yields an mds 
(n, r, n — r -|- 1) code. Matrices which have this property are the Fourier n x n matrices with n a prime 
(Chebotarev’s theorem), the Vandermonde real matrices with positive entries and Cauchy matrices. 

When considering Aw = y, if any r rows of A are chosen for C-^ (notation as in Section I^TT]) then an 
mds code for C is obtained but we haven’t an error-correcting pair to hand as when the rows are evenly 
distributed. Now approach the randomness from another point of view of choose the error-correcting 
pair randomly and this decides the rows to be chosen for the measurements (code); then the randomly 
chosen pair is an error-correcting pair for this code. 

This section enables working with rows of matrices which have the property that the determinant of 
any square submatrix is non-zero as the ‘samples’ for Aw. However the systems in general may require 
more than 2t samples when the w has just t non-zero entries. 

Consider then the following Proposition of Duursma and Hotter [3] . 

(For U,V G F” let 17 * V denote the space generated by {u * v\u G 17, u G V}.) 

Proposition 5.1 (See Proposition 1 of [3].) Let U,V he mds codes with k{U) = t-\- l^k{V) = t. Any 
code C EU *V has distance > 2t -\-1 and has t-error correcting pair {U, V). 

■^More generally it is sometimes enough that Ei * Ej = aEij.j for some scalar a but this is not considered here. 
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5.0.1 Illustrative examples of random selection 

The examples given necessarily have small length so they can be displayed but in general large length 
examples are easily obtained. 


• Example 1: Let n = 19 and let A be the 19 x 19 Fourier matrix with rows {Eg, Ei,..., Fig}. As 
19 is prime any choice of rows of A gives an mds code. We now manufacture a 3-error correcting 
code {t = 3) with 3-error correcting pair. Then randomly choose 4 and 3 rows of A. Suppose then 
U = (El, Eg, Eg, Eio), V = (Eg, Eg, Eg). Then U *V = (Ei, Eg, Eg, Eg, Eg, Egg, En, E 14 , E 15 , Egg) 
and let C-^ = U *V. Then C is a code with distance > 2t + 1 = 7. Actually C-^ is an (19,10, 9) 
code and C is an (19,9,11) code. So in fact the code C is a 5-error correcting code but we just 
have a 3-error correcting pair. 


• Example 2. 

Now let A be as in Example 1. Here we produce a 5-error correcting pair by choosing randomly 
U = (El, Eg, Eg, Eig, Eig) and then choosing V to be 4 of these say V = (Ei, Eg, Eg, Eig). Then 
let C-*- = U *V. Now U *V has 13 elements and so is a (19,13, 6) code and C is a (19, 6,14) 
code. Thus C is a 6 error correcting code and we have a 5 error correcting pair for it. 



( 1 

1/2 

1/3 

1/4 

■A 


1/2 

1/3 

1/4 

1/5 

• Consider the Cauchy (which is Hilbert) matrix A = 

1/3 

1/4 

1/5 

1/6 



1 : 




: / 


Denote the rows of A by Ei, E 2 , ■. Suppose we want a t error correcting code. Let U = 
(Ei,E2,Eg),H = (El, Eg). Then U *V = (Ei * Ei,E2 * Eg, Eg = 1 = Ei,E2 = 1 = Eg, Eg = 1 = Eg) and 
let C-^ = U*V. 


Then 

= ((1,1/4,1/9,1/16,...), (1/2,1/6,1/12,1/20,...), 

(1/3,1/8,1/15,1/24,...), (1/4,1/9,1/16,1/25,...), (1/6,1/12,1/20,1/30,...)) 

is the required code with which to take the ‘samples’. Now C is an (n,n — 5) code (provided the 
elements in C'^ are independent) and is 2-error correcting with error locating pair {U,V); now C 
may be a (n, n — 5,6) code but is by the theory a (n, n — 5, > 5) code. If the elements of C-^ are 
not independent then C is an (n, n — 4, 5) code. 


5.1 Method 

Suppose now A is a matrix such that any square submatrix has non-zero determinant. 

Now choose at random any t -|- 1 rows of A to form U and then any t rows of A to form V. Then let 
C-^ be the space generated by {u=i=?;|u £ U,v € V}. From this it is deduced that d{C) >2t+l and C has 
t-error correcting pair {U,V). Then proceed as before in Section [3] to produce the decoding algorithm 
with the t-error correcting pair with which to solve Aw = y where w has at most t non-zero entries and 
EjW are known for Ej £ C^. 

We don’t need the multiplicative property Ei * Ej = Eij.j on the rows of A although U *V could be 
large; the largest rank that U *V could have is t(t -I- 1) but can often be made of a smaller order. However 
selections can be made so that the resulting code has dimension of 0{t). This for example by choosing 
the rows in E, \U\ = t -\- 1, and in H, \V\ = t to be in arithmetic sequence with the same difference will 
give C-^ = U *V with 2t elements; variations of the differences will also give |E * H| = st for very small 
s (compared to t). 

Being able to randomly choose the error-correcting pairs and thus the measurements C'*" suggests 
that encryption methods may possibly be introduced into the system. 

Thus: 

1. In Aw it is given that w has at most t non-zero entries and that the determinant of any square 
submatrix of A is non-zero. 
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2. Choose t + 1 rows of A to form U and then t rows of A to form V. 

3. Let C-*- = U *V. Then C has distance > 2t + 1 and {U, V) is a t-error correcting pair for C. 

4. The measurements/samples EjW are taken for Ej in a generating set of C'^. 

5. The value of w is then determined by the decoding methods of Section 0] Details are omitted. 


6 Determinants of Submatrices 


The Vandermonde matrix V = V{xi,X 2 , ■ ■ ■, Xn) is defined by 
V = V{xi,X 2 , ...,Xn) = 

\x 

It is well-known that the determinant of V is non-zero if and only if the Xi are distinct. Assume the 
Xi are non-zero. 


1 

1 


Xi 

X2 

Xn 

n-1 

1 

X2~^ . 

■ ^rv 


Proposition 6.1 Let V = V {xi, X 2 , ■ ■ ■ ,Xn) be a Vandermonde matrix with rows and columns numbered 
{0,1, ... ,n — 1}. Suppose rows {ii,i 2 , ■ ■ ■ Ds} and columns ■ ■ ■ ,js} are chosen to form an s x s 

submatrix S of V and that {ii, 12 , ■ ■ ■, is} are in arithmetic progression with arithmetic difference k. Then 


1^1 = xl\ x^^ 


fe2 ■ ■ ' 


,\V{a 


ki 5 ^k2 '^k 


Xi 


Proof: Note that ii^i — ii = k for / = 1,2,..., s — 1, for A: the fixed arithmetic difference. 




*fe2 ■ 

■ 44 



^k2 ■ 

• ^z 

Now S = 


4: ■ 

■ 4: 

and so |5 = 

4} 

-z ■ 

■ 4/ 


\xk 

■ 

■ 44 




• ^Z 


Hence by factoring ont from column i for z = l,2,...,sit follows that 


I*5'! = xl\xl\ ...x\ 


1 

1 

1 

k 

k 

k 

^ki 

Xk2 

Xks 

^2k 

r^2k 

r^2k 


^k2 



(s — l)k 


(s — l)k 


(s—l)fe 


= Xi.\ X 


k 2 * ■ 


JV(x 


''/C2’ • ■ 


□ 


A similar result holds when the columns ■ ■ ■ jjs} are in arithmetic progression. 

Corollary 6.1 IS*] 0 if and only if x'f^,... yf 0. 

Corollary 6.2 IS”! ^ 0 if and only if x\, x\, for i yf j, 1 < i,} < s. This happens if and only if 

(xkiXf^k ^ 1 /or i yf 1 < i,j < s. 


Corollary 6.3 IS”! yf 0 i/ and only if (xkiXf.^) is not a kf^ root of unity for i yf /, 1 < i, j < s. 

Corollary 6.4 If the entries {xi,X 2 , ■ ■ ■ ,Xn\ are real then matrix 151 ^ 0 */ either (i) k is odd or (ii) k 
is even and Xi y^ —Xj for i j ■ 


Corollary 6.5 If the entries {xi,X 2 , ■ ■ ■ ,Xn} are real and positive then |5| 0. 

Corollary 6.6 When Xi = for a primitive root of unity oj (that is, when V is the Fourier nxn 
matrix) and gcd(fc, n) = 1 then |5| 7 ^ 0 . 

Proof: If (xki/xkj)^ = 1 then = 1 and so uj^Vi-kj) _ ^ As w is a primitive root of 

unity this implies that k(ki — kj) = 0 mod n. As gcd(fc, n) = 1 this implies ki — kj =0 mod n in which 
case ki = kj as 1 < ki < n,l < kj < n. □ 
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7 Vandermonde matrices 


Let A = V(xi,X 2 , ■ ■ ■ ,Xn) be a Vandermonde with rows {Eg, Bi,..., En-ij- Then Ei * Ej = Ei+j. As 
in Section [^T] let = {Ej^ , Ej^ , • ■ ■, Ej^). By Corollarv l6.3l if has rows in arithmetic sequence with 
arithmetic difference k and the ratios Xi(xj for i ^ j in A are not roots of unity then C (the dual 
of C"*-) is an {n, n — 2t,2t + 1) code and is t-error correcting with C"*- as the check matrix. As shown in 
Section [3l C has an error correcting pair and Algorithm 14.21 in Section |4] may be applied. 

Thus Vandermonde matrices for which Xijxj are not roots of unity are obvious choices in which 
to take rows of the matrix which are evenly spaced. Then Theorem 13.31 is satisfied and the decoding 
Algorithm 14.11 or 14.21 solves the underdetermined system Aw = y with Vandermonde matrix, provided 
the number of non-zero entries of w is limited. 


Consider then a Vandermonde matrix 


V — V{l3i, 132, ■■ ■ ,(3n) — 


/ 1 

1 

• ' ^ 

Pi 

P 2 . 

Pn 


pr" • 

• p/i-: 


We assume the jSi are distinct and non-zero. 

Define Ek to be (/Sf i > Pn) k € Z. The rows of V are {Eg, Ei,..., En-i}- 


Lemma 7.1 Ei * Ej = Eij.j. 

Thus we obtain the following set-up. Let A = V(,0i,/? 2 , ■ • ■ ,Pn) and Aw = y. Measurements Ejw 
(values of y) are taken or known for j ^ M = {ji,j 2 , ■ ■ ■ ,ju} C {0,1,..., n — 1} where u > 2t. The 
elements in M are in arithmetic progression with difference k and Pi/Pj is not a root of unity for 

j- 

The following Algorithm 17.11 finds w] this is special case of Algorithm 14.21 but can be read here 
independently of this. 

Define Fi = for ji G J Let Oj =< w,Ej^ >= Ej.w for ji G J. Let Ei = Ej. for ji G J. Thus 
Ui =< w, Fi >. 


Algorithm 7.1 



/ ai 

Oi2 

■ OZ-hA 

(i) Find a non-zero element v'^ of the kernel of E = 

02 

O 3 

■ at+2 


\at 

Ot-l-1 

024 / 


(a) Leta= {Fi,E 2 ,...,Ft+i)v'^. 

(in) Suppose v'^ = {vi,V 2 , ■ ■ ■, The component of a is + V 2 p{^'^^ vt+iP/p'^^^); 

we are interested in when this is 0. 

The component of a is 0 if and only if vi + V 2 P/ + Vgf3/^ vt+iPl^ = 0. 


(iv) Let z{a) = {j\aj = 0} which is the set of locations of the zero coordinates of a. Suppose z{a) = 
{zi, Z 2 ,..., it} and denote this set by J. 

(v) Solve sj{x) = s{w). This reduces to solving the following: 


fpii Pi: 

Pi: Pi: 

\piT Pi: 


\ 



'^Oi \ 


X2 

= 

02 

/ 

\XtJ 


\a2t) 


(4) 
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Since the elements in M have arithmetic difference k so that js = + (s — l)k for 1 < s < 2t, this 

equation 0 is equivalent to 


1 

*1 




1 


o(2i-l)fc 

^i2 


ok 


''X2 




r^l' 


xPifxtJ 


/“A 

0'2 

\a2t) 


( 5 ) 


(vi) Then x = {xi,X 2 , ■ ■ ■ ,xt) is obtained from these equations 0) (or from m) and w has entries Xi 
in positions as determined by J and zeros elsewhere. 


The matrix in ([5]) is a Vandermonde matrix. It is sufficient to solve the first t equations and the 
inverse of such a. t x t Vandermonde type matrix may be obtained in Olt^) operations. In connection 
with item |(i)[ finding a non-zero element of the kernel of a Hankel tx (t-t-1) matrix can be done in 0{t^) 
operations. 


In connection with item (iii)[ consider f{x) = ui -|- V 2 X + vsx^ vt+ix^. It is required to find 

those (Bi for which /(/3f) = 0. By Horner’s method /(/3f) may be determined in Off) operations and 
thus finding all i for which /(/3f) = 0 can be done in 0{nf) operations. Choose j € J for item (iv) if 
f{Pj) = 0. Finding the zeros of f{x) takes the maximum of 0(nt) operations and all other operations 
take a maximum of 0{f^) operations. 


Calculations with Vandermonde type matrices obtained from the Fourier matrix are known to be 
stable. 


7.0.1 Which are best? 


A question then is which Vandermonde matrices are best for working with Algorithm 17.11 The Fourier 
matrix cases, which have entries in C, are dealt with in Section [51 
Which Vandermonde real matrices are best? 

Possibilities for investigation include 


V = V(- - -) = 


V = V(a,a^,... 
i ^ jA < hj < n. 


/ 

1 

1 

1 ^ 



1 

1 

1 



2 

3 

n 

a 






/ 1 

1 

1 

\ 

_ 

a 






«2(n-l) 




where ^ is not a k*^ root of unity for 


8 Fourier matrix 

Suppose now that A is the Fourier nxn matrix with rows {Eq, Ei,..., En-i}. Measurements are taken 
of Aw, that is certain EjW are taken or known for j G J = ■ ■ ■ ,ju} and it is given that u > 2t 

where t is the maximum number of non-zero entries of w. 

Theorem 8.1 Suppose the Ej in C'^ = {Ej^,Ej,^,... ,Ejf) are evenly spaced with arithmetic difference 
k satisfying gcd(n, fc) = 1. Then any uxu square submatrix of C has non-zero determinant. 

Proof: 

This follows directly from Corollary 16.61 □ 

Proposition 7 of [TT] may also be used to prove Theorem 18.11 above. This Proposition 7 of m is 
analogous to Chebotarev’s theorem. 
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Corollary 8.1 Let C be the code with check matrix from C'^ = {Ej^, Ej^,..., Ej^) where the Ei^ are 
evenly spaced with arithmetic difference k satisfying gcd(n, fc) = 1. Then C is an mds (n,n — u,u + 1) 
code. 

Consider cases where u > 2t. Here C is a (n, u) matrix and C is a (n, n — u) matrix. It is required 
that C be a t-error correcting code and thus it is required that C be a (n, n — m, > (2t + 1)) code. For 
this to happen it is required that any 2t columns of C be linearly independent. 

Let A be Fourier n x n matrix with rows {i? 0 i Ei, ■ ■ ■, En-i}. When n is prime the code generated 
by {Ej^, Ej ^,..., Ej^) is an {n,u,n — u + 1) code; see [S] . In this case then = {Ej^, Ej ^,..., Ej^) 
with u = 2t generates an (n, 2t, n — 2t + 1) code and C, its dual, is an (n, n — 2t, 2t + 1) code. Thus C is 
a t-error correcting code. Now it is required to find a decoding algorithm for w as an error word of this 
code. 

Assume that the Ej^, are evenly distributed, that is, C'^ = ... £'i+( 2 t-i)j) where 

suffices are taken mod n. 


8.1 Algorithm for Fourier 

This Algorithm is a special case of previous algorithms but can be read here independently. 

Suppose y = Ax where A is an n x n Fourier matrix, w an n x 1 unknown vector and where u entries 
of y are known. It is given that w has at most t non-zero entries and that u > 2t. Denote the rows of A 
by {Eo,Ei,...,En-i}. 

Measurements EjW (values of y) are taken or known for j G J = {ji, j 2 , ■ ■ ■ ,ju} where u > 2t. We 
give an Algorithm to calculate the value of w when the measurements are in an arithmetic progression 
(evenly distributed) with difference k satisfying gcd(n, fc) = 1. 


8.1.1 Case k = I 

We first for clarity give the algorithm when K = {1,2,..., 2t}. This is easier to explain and avoids the 
complicated notation necessary for the general case given below. The results and algorithm obtained in 
this case, where the measurements are taken consecutively, are similar to those in m- 

The set-up then is that A is the Fourier n x n matrix with rows {Eq,Ei, ... ,En-i} and that mea¬ 
surements EiW are taken for f = 1, 2,..., 2t. It is assumed that w has at most t non-zero entries. Then 


Algorithm 8.1 


i' i £ J 

= {1,2,. 

.,2t}. 

/ ai 

02 


02 

03 

0:t+2 

\at at+i ■ ■ ■ 

Ot2t / 


1. Find a non-zero element of the kernel of E = 


2. Let a = {Ei, E 2 , ■ ■ ■, Et+i)x'^. (Any non-zero multiple of a will suffice as we are only interested in 
the zero entries of a. Note that a is a 1 x n vector.) 

3. Let z(a) = {j\aj = 0} which is the set of locations of the zero coordinates of a. Suppose z(a) = 
{ji, * 2 ) •■■,**} denote this set by J. 


4- Solve sj{x) = s{w). This reduces to solving the following: 


/ w'l-i 


. a;2(z*-i) 


fxff 

X2 


\ 

02 

^^^2tpi-l) 

^2t(i2-l) 



\XtJ 


\Q!2t/ 
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This is equivalent to solving the following: 


/ 1 

1 

1 ^ 




faA 





L0^--^X2 


CX2 

^^2t(ii-l) 


^2t(jt-l) ^ 




\a2tj 


5. The value of w is then obtained from the solution x = (xi, X 2 , ■ ■ ■ ,xt) of equations & (or equations 
&) with entries Xi in positions as determined by J and zero elsewhere. 

The complexity of the operations is discussed in Section 18.1.31 
8.1.2 General Fourier case 

Suppose A is an n X n Fourier matrix. Denote the rows of A by {Flo? F'l, ■ • ■, En-i}. 

Measurements EjW are taken or known for j € M = {ji, j 2 , • ■ •, J 2 i} C {0,1,..., n— 1}. The elements 
in M are in arithmetic progression with difference k satisfying gcd(n, k) = 1. Thus js = ji + (s — l)k for 
s = 1, 2,..., 2t. Then w is calculated by the following algorithm. 

Let Qffe =< w, Ej^ >= Ej^w for jk € J. Define Fi = Ej^ for ji G J. Thus ak =< w, Fk >= F^w. 

Algorithm 8.2 



/ ai 

02 

■ Ot+i\ 

(i) Find a non-zero element v'^ of the kernel of E = 

02 

03 

■ Ot+2 


\at 

Ot+1 . 

02t / 


(a) Leta = {Fi,F 2 ,...,Ft+i)v'^. 

(Hi) Suppose v'^ = {vi^V 2 , ■ ■ ■ ,Vt+i)'^■ The component of a is 
; we are interested in when this is 0. 

The component of a is 0 if and only if vi + + ... + = 0. 

(iv) Let z{a) = {j\aj = 0} which is the set of locations of the zero coordinates of a. Suppose z{a) = 
{ii, i 2 , ■ ■ ■, it} and denote this set by J. 

(v) Solve sj{x) = s(w). This reduces to solving the following: 



I^il(i2-l) 

I^i2(j2-l) 

I^i2(it-1) 


^Xi'^ 

X2 


^Oi \ 
02 

y^j2t(u-i) 




\Xtj 


\02t/ 


Since js = ji + k{s — 1) this reduces to solving the following system of equations: 


/ 


LO 


1 

fc(ii-l) 






2fc(ii-l) 


UJ 


fe(i2-l) 

2fe(l2-l) 


LO 


LO 


1 

fc(it-l) 

2fe(*t-l) 


\ 





/^n(ii-i)a:i\ 


'^Oi \ 


^n(i2-l)2.2 

_ 

02 




\a2t) 


( 8 ) 


(9) 


(vi) Then x = (xi, a; 2 ,..., Xt) is obtained from these equations from which w is derived with entries 
Xi in positions as determined by J. 


15 
























8.1.3 Complexity 


Finding the kernel of E is of 0{t^) as it involves finding the kernel of a t x (t + 1) Hankel matrix, 
which is this case has dimension 1 in order to satisfy the given conditions. Superfast algorithms of 
O(tlog^t) with which to find the kernel of a Hankel matrix have been proposed. Item (iii) as already 


pointed out in Section [7l can be done in 0{tn) operations; however by considering a Fourier Transform 
of (ui, U 2 ,..., Ut, 0,..., 0) it can be performed in 0{n log n) operations by a Fast Fourier Transform. 

The matrix ([5]) is a special Vandermonde type involving roots of unity only. There is a formula for 
the inverse of any Vandermonde matrix, the Bjdrk, Pereyra method [T], which involves 0(t^) operations. 
Finding the inverse of a Vandermonde matrix with roots of unity is known to be particularly stable. The 
method of Bjork, Pereyra [I] involves divisions by {ai — aj) where ai ^ aj and in these cases the ak are 
roots of unity. The system m or do]) could also be solved using the Forney Algorithm/formula, see [2] 
Chapter 7. 
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